APPLICATION NO. 10/772,597 

INVENTION: Decisioning rules for turbo and convolutional decoding 
INVENTORS: Urbain A. von der Embse 



Marked up version of the SUBSTITUTE SPECIFICATION 



APPLICATION NO. 10/772,597 

INVENTION: Decisioning rules for turbo and convolutional decoding 
INVENTORS: Urbain Alfrod A . von der Embse 



BACKGROUND OF THE INVENTION 



I, Field of the Invention 

10 TECHNICAL FIELD 

The present invention relates to both convolutional 
decoding and to turbo decoding for communications applications 
and in particular to mobile, point-to-point and satellite 
communication networks, CDMA (Code Division Multiple Access) and 

15 OFDMA (Orthogonal Frequency Division Multiple Access) cellular 
telephone and wireless data communications with data rates to 
multiple Tl (1.544 Mbps) and higher (>100 Mbps) , and to optical 
WDMA (Wavelength Division Multiple Access) links with data rates 
to >100 GBps (Gega bit per second) and higher ranges. More 

20 specifically the present invention relates to novel a-posteriori 
probabilities and decisioning metric paradigms and architectures 
which reduce the number of arithmetic multiply operations and 
thereby reduce the computational complexity, improve iterative 
convergence thereby reducing complexity, improve bit error rate 

25 JBER)_ performance, and provide new metric processing algorithms 
to support the various decoding algorithms. 
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II. Description of the Related Art 



Current art is represented by the recent IEEE publication 
in reference [1] which summarizes the theorectical and 
5 applications work on turbo codes , books on turbo codes in 
references [2] , [3] , [4] , [5] , the paper by Vitcrbi in reference [5] 
which — formulates — the — maximum — a - pootcriori — MAP — turbo — decoding 

algorithm — if* — terms &§ — the convolutional — decoding — maximum 

likelihood — ML — algorithms , — the — IEEE — publications — aftd — articles 
10 addressing — turbo — decoding — ift — references — [6] , [7] , [8] — and the 
reference text on the theorectical foundations of probability and 
decisioning metrics [9] . In addition there are the fundamental 
patents on turbo decoding. 

15 Decisioning — Maximum likelihood ML decisioning m etrics DM 
are currently used in turbo and convolutional decoding wherein DM 
is arc the the natural logarithm of the ML probability which is 
the conditional Gaussian probabilities — probability of the 
observed communications channel output symbol y at — clock — k 

20 corresponding to — the received codeword k, assuming that the 

transmitted symbol is x^ at k. — _This defines . the decisioning 
metric DM in equations (1) where In is the natural logarithm and 
log is the logarithm. When — we — rcf cr Ref erence to log it — is 
understood that — w eto mean the natural logarithm since it is 

25 always 
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Decisioning metric DM 

1 ML probability p(y|x) is the Gaussian conditional 
probability p (y I x) 



(1) 



p(y|x) = exp(-|y-x| 2 /2a 2 )/(2*) 1/2 a 



2 Log of the GaussianM L 



ln[p(y|x) ] = - I y-x| 



2 /2a 2 -ln[ (2tt) 1/2 a] 



2 



3 Decisioning metric DM is the negative of the log 

of the ML probability with the additive constant term 
removed 

5 DM(y,x) = -|y-x| 2 /2a 2 

wherein the constant l/2q 2 scales the DM relative 
to the noise floor 2a 2 of the symbol detector 



used in turbo decoding and in convolutional decoding. Step 1 is 
the definition of the zero-mean conditional Gaussian probability 
density function. Step 2 is the log. Step 3 is the decisioning 
metric DM that measures the distance between y and x, where a is 
the one sigma value of the inphase and the quadrature noise. This 
DM metric is used in the convolutional decoding algorithm, and in 
the turbo decoding algorithm when combined with the a-priori 
probability of the correct decoding bit. The DM metric is a ML 
distance metric and the functional form is determined by the 
zero-mean Gaussian assumption for the link and receiver 
processing noise. 

Maximum a-powteriori probability M AP turbo decoding starts 
with the aooumptions that wo arc — decoding a sequence of observed 
25 channel output symbols {y (k) , k=l,2,...,N} of the receiver where k 
is the running index over the N transmitted symbols. Each oot 
y (k) — of oymbols for codeword k conoioto of the obocrved uncoded 
and coded oymbolo for the received codeword k. 

30 FIG. 1 is a representative turbo encoder block diagram for 

a parallel architecture. Input 1 to the encoder are the user data 
bits {d(k)} for k=l / 2 / . . .,N. The encoder for a turbo code uses 
a recursive systematic code RSC which means the first codeword 
bit 2 is the user data bit called systematic bit, or bits, which 
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are uncoded. These user data bits {d(k)} are also handed over 
to the first RSC encoder 3 called #1 encoder, and after 
interleaving 4 are also handed over to the second RSC encoder 5 
called #2 encoder. User data bits and the encoder output bits 
5 are punctured 6 to obtain the correct code rate and then 
multiplexed into a continuous output bit stream 7 of codewords 

{c(k)} for each of the codeword clocks k=l,2, ,N. Each 

codeword c(k) is a set of bits consisting of the systematic bits, 
#1 encoder output bits, and #2 encoder output bits. 

10 

FIG. 2 is a representative transmitter block diagram for 
implementation of both the turbo encoder in FIG. 1 and the 
convolutional encoder in FIG. 7. Signal processing starts with 
the input stream {d(k)} of user data bits 8 to the 

15 convolutional /turbo encoder 9. Output 10 of the 
convolutional /turbo encoder in FIG. 1 are the stream of codewords 
{c(k)} handed over to the frame processor. Frame processor 11 
accepts these codewords and performs error detecting coding such 
as a CRC (cyclic redundant code) and frame formatting, and 

20 passes the outputs to the symbol encoder 12 which encodes the 
data onto amplitude and phase with possible frequency and time 
assignments and w hose outputs are the transmitter symbols {x(k)} 
corresponding to the codewords of the convolutional/turbo encoder 
output as well as the other symbols for the frame data including 

25 the CRC. Framing can be done before and/or after the turbo' 
encoding. Transmitter symbols {x'(k) } are modulated 13 into a 
waveform. Modulator output signals for multiple channels are 
multiple-access processed and combined 14 for handover 14 as a 
stream of complex baseband digital signal samples {z(ti)} where ti 

30 is a time index, to the digital-to-analog conversion processing 
15 which converts the complex baseband input signal from the 
multiple access processing into a single sideband SSB upconverted 
real signal v(t) 15 at an intermediate frequency IF where 
{z(ti)} is the stream of complex baseband signal input samples 

35 at the digital times {ti} to the digital-to-analog conversion. 
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The digital-to-analog processing also includes beam forming 
calculations for both digital and analog beam-forming antennas. 
Multiple access examples in 14 are time division multiple 
access TDMA, frequency division FDMA, code division CDMA, space 
5 division SDMA, frequency hop multiple access FHMA, and all 
combinations of these and others not mentioned but inferred from 
this representative list. 

For multiple beam antennas 16 in FIG. 2 the beam 
10 coefficients for each beam element for each complex digital 
sample are processed 15 and the individual digital streams are 
handed off to the corresponding antenna elements where they are 
SSB upconverted to an IF and processed by the analog front end 
16 at each element and the array of elements form the beams and 
15 within each beam the transmitted signal is similar to the real RF 
signal v(t) in 17 for a single beam. For single beams the 
analog front end 16 upconverts and amplifies this IF signal and 
transmits it as the real RF signal v(t) 17. This real waveform 
v(t) 17 is at the RF carrier frequency f 0 and is the real part 
20 of the complex envelope of the baseband waveform z(t) multiplied 
by the RF carrier with the phase angle <J> which accounts for the 
phase change from the baseband signal to the transmitted signal. 

MAP (maximum a-posteriori probability) joint probability 
25 used in the MAP turbo decoding algorithm is defined in equations 
(2) which are taken from references [1],[2]. Definition 1 
introduces common terminology in 



30 

MAP joint probability for turbo decoding (2) 
1 Definitions 

S(k) = Decoder trellis state at clock k 

= Decoder shift register state at clock k 
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k = Index of received codewords 

= trellis decoder states 
= decoding clock 
s',s = Values of S(k-l), S(k) respectively 
y = Set of observed channel output symbols 

= {y(k), k=l,2,...,N} 
y (k) — - Output symbols for codeword k 

= [y(k,b)) where b roforo to a codeword bit 

~ (y(k), y(k), y(k)) for both ftl encoder 
— aftd — If 2 encoder depending on the text 

y (k, b^l) — ~ uncoded bit (o) — in codeword k 

RSC = Recursive systematic code 

= Systematic code SC with feedback which is a 
requirement for turbo decoding 
Parallel encoding = Encoding configuration for turbo 
decoding which transmits the symbols using a 
parallel architecture/ which is the assumed 
architecture for this invention disclosure 
y(k) = Output symbols for codeword/clock k 
{y(j<k)} = Output symbols for clocks j=l,2,..., k-1 
{y(j>k)} = Output symbols for clocks j=k+l, ,2,...,N 

2 Decoding states and observations 

Observations are the set {y(k), k=l,2,...,N) 

I j/^ 

1 k = 1,2,...,N N 

Subsets y (j<k) f y(k) ,y(j>k) of y are of interest 




y(j<k) y(k) y(j>k) 



5 Decoder trellis states of interest are s',s 

I ->| | | ->| 

k-1 k k+1 n 

S(k-l)=s' S(k)=s 

10 



3 MAP joint probability 

The joint probability of interest for MAP is 

P(s',s,y) =p(s',s, y ( j<k) ,y (k) ,y ( j>k)]_ 

15 



turbo decoding literature. In 2 the decoding states s',s are 
defined at clocks k-l,k and the observations are defined over the 
j=l, 2, k-1 as y(j<k), over j=k+l, N as y(j>k), and at k as 
20 y(k). In 3 the MAP joint probability is defined as a function of 
these decoder states and observations. 

Recursive equation for the MAP joint probability is derived 
in equations (3) by reformulating the joint probability equation 
25 in 3 in equations (2) as a function of the recursive state 
estimators a, p and the state transition probability y. Step 1 
is the application of Bayes rule to partition the joint 
probability. Step 2 takes advantage of the assumption that the 

30 

Recursive formulation of MAP joint probability (3) 
1 Bayes theorem or rule p(a,b)=p(a|b)p(b) can be used to 
rewrite the MAP joint probability in 3 in equation (2) 
P(s',s,y) = p(s',s, y (j<k) ,y (k) ,y (j>k) 
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= p(y(jf>kHs' ,s, y(j<k),y(k)) 
*p(s',s, y(j<k),y(k)M 
where is a multiply operation 

5 2 Assuming. the channel is memoryless 

p(s',s,y) = p(y(jK>kHs) p(s',s, y (j<k) , y (k) ) 

3 Re-applying Bayes rule and the assumption that 
the channel is memoryless 

10 p(s',s,y) =p(y(j>k)|s) p(s,y(k)|s') p(s',y(j<k)) 

4 This equation can be rewritten as a function of the 
recursive estimators and state transition probability 

p(s,s' ,y) = p k (s) y k (s,s') <x k -i(s') 
15 where by definition 

0k(s) = P(y(j>k) Is) 
Jk(s,s' ) = p(s,y(k) Is' ) 
a k -i(s' ) = p(s f f y(j<k) ) 

20 

channel is memoryless to simplify the partitioning in step 1. 
Step 3 re-applies the Bayes rule and the memoryless assumption to 
re-partition the equation and simplify it to the final form used 
in the MAP algorithm. Step 4 transforms the joint probability in 
25 step 3 derived "as a product of three probabilities, into the 
equivalent product of the two estimators <x k -i(s') ,p k (s) and the 
state transition probability y k (s,s')for the MAP algorithm. 

Forward recursive equation for the state estimator ot k (s) is 
30 derived in equations (4) as a forward recursion which is a 
function of y k {s,s') and the previous estimate a k -i(s'). Step 1 
starts with the definition of a k (s) which is derived from the 
equation for <x k _i(s') in 4 in equations (3). In Qtcp Step 2 we 
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introduces the state s' by observing that the probability summed 
over all values of s' is equal to the probability with s' 
excluded. In otcp Step 3 we apply applies Bayes rule to partition 
the probabilities. In step 4 the assumption that the channel is 
5 memoryless enables the equation to be simplified to the form used 



Forward recursive equation for a k (s) (4) 

1 Definition of a k _i(s') in 4 in equations (3) gives 
10 a k (s) = p(s,y(j<k),y(k)) 

2 This probability can be written as the sum of 
joint probabilities ovier all possible states of s' 
<x k (s) = Zaii s' p(s,s' ,y (j<k) ,y (k) ) 

15 

3 Applying Bayes rule 

a k (s) = Zaii s' p(s,y(k) I s' , y ( j<k) ) p (s' , y ( j<k) ) 

4 Applying the channel memoryless assumption 
20 <x k (s) =Iaii S ' p(s,y(k) |s')p(s',y(j<k)) 

5 Substituting the definitions of y k (s / s / ) and 
0t k -i(s') from 4 in equations (3) 

a k (s) = Zall s' Jk(S,S') Ct^S') 

25 



in the MAP algorithm. In step 5, substitution of Yk(s,s') and 
a k -i(s') from 4 in equations (3) gives the final form for the 
recursive equation for a k (s) . 

Backward recursive equation for the state estimator P k -i(s') 
is derived as a backward recursion in equations (5) as a 
function of the y k (s,s') and the previous estimate p k (s), 
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following the steps in equations (4). Step 1 derives pk-i(s') 
from the equation for p k (s) in 4 in equations (3) . Step 2 
follows steps 2,3,4 in the derivation of a k (s) in equations (4). 

Backward recursion equation for Pk-i(s') (5) 

1 The definition for p k (s) from 4 in equations (3) 

Pk-i(s') = p(y(j>k-l) Is') 

2 Following steps similar to steps 2,3,4 in equations (4) 

Pk-i(s') = Zaii s p(y(j>k) Is)p(s,y(k) Is') 

3 Substituting the definitions of Yk(s,s') and 
p k (s) from 4 in equations (3) 

Pk-i(s') = Zaii s Pk(s) y k (s,s') 



In step 3, substitution y k (s,s') and Pk(s) from 4 in equations 
(3) gives the final form for the recursive equation for p k -i(s'). 

State transition probability y k (s,s') and the log^ . y k (s, s' ) 
of Yk(s, s' ) are derived in equations (6). The y k (s,s') is the 
probability of 



State transition probabilities y k (s, s' ) ,x k (s, s' ) (6) 

1 From the definition of y k (s,s') from 4 in 

equations (3)_and Bayes rule 
Yk(s,s' ) = p(s,y (k) |s' ) 

= p(y(k) |s,s') p(s|s') 

2 Define 
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d(k) = input bit necessary to cause the 

transition from state S(k-l)=s' to S(k)=s 
p(d(k)) = a-priori probability of d(k) 
x(k) = transmitted codeword symbols defines the 
transition from S(k-l)=s' to S(k)=s 
= (x(k,b)) where b refers to the codeword bit 
y(k) = received codeword symbols defined by tho 

transition from S (k-1) ~o' to S(k)-p for 

codeword/clock k 



10 = {y(k,b)} where b refers to the codeword bit 

3 With these definitions and the memoryless assumption, 
the Yk(s,s') equation in 1 becomes 

Yk(s,s') = p(y(k) |s,s') p(d(k)) 
15 = P(y(k) |x(k) ) p(d(k) ) 

= lib P(y(k,b) |x(k,b)) p(d(k)) 

4 Assume the channel is Gaussian and the symbols are BPSK 
Y k (s,s')= lib exp( -|y(k,b)-x<k,b) | 2 /2a 2 )/(27t) 1/2 a 

20 * p(d(k)) 

5 The DM from 3 in equations (1) can be rewritten 
DM(s|s')= £ b DM(y(k / b) , x (k, b) ) 

= Z b -|y(k / b)-x(k / b) | 2 /2a 2 



6 Log equation for Zk(s,s r ) takes the log, 
uses DM, and deletes the additive constant 
^(5,3') = DM(sls') + p(d(k)) 
wherein p (d (k) ) =log (p (d (k) ) ) 



the decoder trellis state S(k-l)=s' transitioning to the next 
state S(k)=s symbolically written as s'^s. ifi — otcp Step 1 we 
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ipplies Bayes rule to the definition of y k (s,s') in 4 in 



equations (3). Step 2 are definitions. Step 3 uses these 
definitions to transform the Yk(s,s') into the product of the 
conditional probabilities p(y(k)|x(k)) of the received codeword 
symbols {y(k)} given the transmitted codeword symbols {x(k)}, and 
the a-priori probability p(d(k)) causing this transition. The 
p(y(k)|x(k)) is the product over the bits b=l,2,... for the #1 or 
#2 encoders in FIG. 1 depending on which is being addressed, of 
the probabilities for each bit p (y (x,b) | x (k,b) ) . 

ift — otcp Step 4 we — introduce^ the standard turbo code 
assumption that the channel is Gaussian and uses BPSK (Binary 
phase shift keying) symbols which means d(k)=+/-l when 
interpreted as a BPSK symbol, and a is the one sigma Gaussian 
inphase and quadrature__noise . In otcp Step 5 we— observes that the 
DM metric is a function of the states s,s' which is equal to the 
sum of the DM metrics over the bits {b} of the codeword 
corresponding to the transition from S(k-l)=s' to S(k)= s. In 
step 6 the equation for the log_^ ¥k(s,s')/_ of y k (s,s') as a 
function of the DM metric and the log_j_ p(d(k))_^ of p(d(k))y is 
used in turbo decoding algorithms, and in convolutional decoding 
algorithms when j>(d(k)) is deleted. 

Log equations for a k (s), J3 k -i(s') are derived in equations 
(7) from equations (4) , (5) respectively for a k (s), Pk-i(s') 
using the definition of ¥k(s,s') in 6 in equations (6). Step 1 
gives the log equation for a k (s) by taking the 

Log equations for a k (s), j3 k -i(s') (7) 
1 Log_^ a k (s) , of a k (s) 




a k (s) = ln[£a lls , expCo^ifs' )+DM(s|s f )+ £(d(k))] 
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2 Log, 3k-i ( s ' ) , of 3 k-i (s') 

fi k _!(s')= ln[ Zaiisexp ( g k (s)+DM(s|s' )+ £(d(k))] 



5 log of the cc k (s) equation in 5 in equations (4) and using the 
definition of y k (s,s') in 6 in equations (6). Step 2 takes the 
log of the equation for p k -i(s') in 3 in equations (5) to derive 
the log equation for golfs') and uses the same definition for 
lk(s,s' ) . 



MAP equations for the log likelihood ratio L(d(k)|y)) are 
derived in equations (8) . Step 1 is the def initon from references 
[1],[2]. Step 2 uses the Bayes rule P (a, b) =P (a | b) P (b) with the 
p(y) cancelled in the division. Step 3 replaces p(d(k)) with the 



MAP equations 



(8) 



1 Definition 



20 



L(d(k)) |y) = ln[ p(d(k)=+l|y) ] 
-ln[ p(d(k)=-l|y) ] 



25 



2 Bayes rule allows this to be rewritten 
L(d(k)) |y) = ln[ p(d(k)=+l,y)] 
-ln[ p(d(k)=-l,y) ] 



3 Probability of p(d(k)) is the sum of the probabilities 
that the state S(k-l)=s' transitions to S(k)=s for the 



assumed values d(k)=+l and d(k)=~l 
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L(d(k))|y) = ln[ 2 (s , s , , d(k)==+ i, p(s,s',y)] 
-ln[ Z (s ,s'id<k)~i) p(s,s',y) ] 
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4 MAP equation is obtained by substituting the 
±eg~a k .-i(s' ) ,gk(s) , Xk(s,s') into 3 

L(d(k))|y) = ln[ 2 (s , sMd(k)=+1) p(s f s' f y)] 
-ln[ E (Sr s'id(k)-i) p(s,s',y) ] 

= ln[Z (s , sMd(k) . +1) exp(a k ^(s' )+DM(s|s' )+£(d(k) )+J3 k (s) ) ] 
-ln[2 (s , sMd(k)= _ 1) exp(a k _ 1 (s / )+DM(s|s' )+g(d(k) )+fi k (s) ) ] 

5 Decide d(k) = +1 when L(d(k)|y) > 0 

= -1 when L(d(k) |y) < 0 



equivalent sum of the probabilities that the transition from 
S(k-l)=s' to S(k)=s occurs for d(k)=+l and for d(k)=-l. Step 4 
substitutes the log of the recursive estimators a k _i (s' ) ,fik(s) , 
from 1,2 in equations (7) and the state transition probability 
y k (s / s / ) from 6 in equations (6). In step 5 the hard decisioning 
rule is d(k)= +/-1 iff L(d(k)|y) >/< 0 and the soft decisioning 
metric is the value of L(d(k)|y). 

MAP turbo decoding iterative algorithm is defined in FIG. 3 
and in equations (9) for a parallel architecture using the MAP a- 
posteriori equation in equations (8) with BPSK (Binary Phase 
Shift Keying) modulation. This basic algorithm is used to 
illustrate how the decisioning metric DM is implemented, and is 
representative of how the DM metric is used for the more 
efficient algorithms such as the Log-MAP, Max-Log-MAP, iterative 
SOVA , and others, for parallel and serial architectures and 
other variations, and for modulations other than BPSK. 

FIG. 3 inputs are the detected soft output symbols 18 from 
the received channel demodulator which detects and recovers these 
symbols. This stream of output symbols consists of the outputs 
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{y(k / b=l)} for the systematic bit b=l which is the uncoded bit, 
the subset of the output symbols from #1 docodor encoder 3 in 
FIG. 1, and the remaining output symbols from #2 decoder e ncoder 
5 in FIG. 51. Systematic bits are routed to both #1 decoder 20-22 
5 and #2 decoder 2125. Encoded bits from #1 and #2 encoders are 
separately routed 19 to #1 and #2 decoders. The detailed decoding 
in FIG._3 will be described in parallel with the MAP turbo 
decoding iterative algorithm in equations (9). In equations (9), 
step 1 defines the various parameters used in the turbo decoding 
10 iterations. 

Step 2 starts iteration M=l in FIG.__3 for #1 decoder 22. 
Extrinsic information L ie from this decoder 22 in FIG.__3 for M=l 
is calculated in step 2 in equations using the soft outputs 

15 {y(k / b=l)} 20 of the received channel for the systematic bit b=l 
which is the uncoded bit, the subset of the detected output 
symbols 19 which are from #1 decoder 3 in FIG. 1, and the #1 
decoder likelihood ratio output Li calculated from 4 in equations 
8. The a-priori information on p(d(k)) in 4 in equations (8) 

20 from #2 decoder 25 is not available so we — set £(d(k))=0 
corresponding to p (d (k) =+1) =p (d (k) =-1 ) = 



MAP turbo decoding iterative algorithm (9) 
25 Step 1 Definitions 

L m = { L(d(k=l) |y) ), k=l,2,....} for m=#l,#2 decoders 

= a-posteriori likelihood ratio 
L rae = { L me (d(k=l) |y)), k=l,2,....} 

= extrinsic information from m=#l / #2 decoder 
30 « a-priori estimates of In [p (d=+l) /p (d=-l) ] 

which defines p for the other decoder using 
equations JIO)^ to solve for g 

L le = Interleaved L ie 

^2b ' L 2 = De-interleaved L 2e $ L 2 
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y(k,b=l) = y for uncoded bit b=l 

y (k,b=l) = interleaved y for uncoded bit b=l 



5 Step 2 Iteration M=l starts the turbo decoding 

Lie = Li - 0 - (2/a 2 )Re[y(k,b=l) ] 
L 2e = L 2 - L le - (2/a 2 )Re[y (k,b=l)] 
where Re(o) = Real(o) 

10 s Step 3 For iteration M=2,3, ... 

L le = Lx - - (2/a 2 )Re[y(k,b=l) ] 

L 2e = L 2 - L le - (2/a 2 )Re[y (k,b-l) } 

4Step 4 Decode after last iteration 
15 Decide d(k)=+l/-l = 1/0 bit value 

for L 2 (d(k) | y) >/<0 for k=l,2,. . . 
where d (k) is the estimate of d(k) from turbo decoding 



20 

Step 2 next proceeds to #2 decoder 25. A-priori estimates 
for p(d(k)) are calculated from the extrinsic information from #1 
decoder after interleaving 23 in FIG. 3 in order to align the 
bits with the interleaved bits 4 in FIG. 1 which are encoded by 
25 the #2 encoder 5. Calculation of the a-priori £ for #1,#2 
decoder using the extrinsic information from #2,#1 decoder is 
given in equations (10) from references [2] , [4] . Inputs to the 

A-priori calculation of £ in 4 in equations 8 (10) 
30 K [1+ exp(L me )] 

p(d(k)= -1) = -ln(K) 
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£(d(k)= +1) = L M -ln(K) 

#2 decoder 25 in FIG._3 are the detected output symbols 19 from 
5 the #2 encoder 5 in FIG. 1, the detected symbols for the 
systematic bits 21 after interleaving 24 , and the extrinsic 
information from #1 decoder 22 after interleaving 23. 
Calculation of the extrinsic information L 2e from #2 decoder is 
given in step 2 in equations (9) . 

10 

Step 3 repeats step 2 with the addition subtraction of the 
de-interleaved 26 extrinsic information input L 2e to #1 decoder 

22 from #2 decoder 25. This is used to calculate the a-priori 

probabilities £ using equations (10) for use in the evaluation of 
15 the a-posterior likelihood ratio L x from decoder #1, and also 
used in the calculation of the extrinsic information L ie for 
decoder #1 in step 3 in equations (9) . 

Step 4 is the calculation of the estimates {d(k)} for the 
20 transmitted information {d(k)} in the form of + /-1 used in the 
iterative algorithm to model the BPSK modulation with values +/-1 

for the estimated input signal {d(k)} in 28 with +1 
corresponding to the bit value 1 and -1 for the bit value 0. The 

de-interleaved 27 a-posteriori maximum likelihood ratio L 2 from 
25 #2 decoder in FIG. 3 yields these output bits 28 using the hard 

decisioning rule that decides 1/0 depending on whether the L 2 is 
>0 or <0. 

Convolutional decoding will be discussed in the disclosure 
30 of the new invention. 
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FIG. 4 is a representative demodulation receiver block 
diagram for implementation of the turbo decoder in FIG. 3 and the 
convolutional decoder in FIG. 8, which emphasizes the 
demodulation processing for both single and multiple channels. 
5 The signal processing starts with the user transmitted wavefronts 
29 incident at the receiver antenna for the n u users u =l,... f n u < 
N c . These wavefronts are combined by addition in the antenna to 
form the receive Rx signal v(t) at the antenna output 30 where 
v(t) is an estimate of the transmitted signal v(t) 17 in FIG. 

10 2, that is received with errors in time At, frequency Af, phase 
A8, and with an estimate z(t) of the transmitted complex baseband 
signal z(t) 14 in FIG. 2. This received signal- v(t) is 

amplified and downconverted by the analog front end 31 and then 
synchronized and analog-to-digital ADC converted 32. Outputs 

15 from the ADC are handed over to the multiple access channel 
recovery signal processing 33 and the demodulation processing 
34 where the waveform is removed to recover the symbols 35. These 
detected symbols 35 are turbo/convolutional decoded 36 to 

recover estimates { d(k) } of the received data which are processed 
20 by the frame processor 37 to recover estimates 38 of the 

transmitted user data words. The serial processing for the 
. multiple access channel recovery and the demodulator is combined 

for several of the multiple access schemes and for the 

demodulation such as GMSK. As noted in the discussion for FIG. 2, 
25 the frame processing can be before and/or after the turbo 

decoder. 

It should be obvious to anyone skilled in the 
communications art that this example implementation clearly 
30 defines the fundamental current turbo and convolutional encoding 
and decoding signal processing relevant to this invention 
disclosure and it is obvious that this example is representative 
of the other possible signal processing approaches. 
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For cellular applications the transmitter description 
describes the turbo and convolutional encoding transmission 
signal processing applicable to this invention for both the hub 
5 and user terminals, and the receiver describes the corresponding 
turbo and convolutional decoding receiving signal processing for 
the hub and user terminals for applicability to this invention. 

For optical communications applications the microwave 
10 processing at the front end of both the transmitter and the 
receiver is replaced by the optical processing which performs the 
complex modulation for the optical laser transmission in the 
transmitter and which performs the optical laser receiving 
function of the microwave processing to recover the complex 
15 baseband received signal with the remainder of the signal 
processing functionally the same as described in FIG. 2 for the 
turbo and convolutional encoding transmitter and in FIG. 4 for 
the turbo and convolutional decoding receiver. 

20 

SUMMARY OF INVENTION 

This invention introduces the a new decisioning metrics in 
25 this invention for turbo decoding and convolutional decoding, 
the a new MAP joint probability for turbo decoding, ^ke — a new 
formulation to replace the ML probability for convolutional 
decoding, and the corresponding new estimators that replace the 
current recursive estimators a k _i,p k , and the new replacement 
30 for the state transition probability y k used for both 
convolutional and turbo decoding. It will be apparent to the 
reader that these probability equations together with the 
decisioning metrics provide new mathematical paridymo framework 
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for the decoding algorithms, and offer an improvement in BER 
performance, rate of convergence for turbo decoding, and lower 
implementation complexities. 

5 The MAP joint probability for turbo decoding is p(s,s',y) 

defined in 3 in equations (2), where s,s' are the decoding 
states for symbol sets k,k-l respectively and y is the complete 
set of observed symbol sets for k=l,2,...,N. The current 
practice uses the p(s,s',y) in the MAP equations (8) wherein the 
10 MAP a-posteriori log likelihood ratio L(d(k) |y) in 3 in equations 
(8) reduces to the natural log of the ratio of the sum of 
p(s,s',y) over s,s' for d(k)=+l, to — ratio — e£— the sum of 
p(s,s',y) over s,s' for d(k)=-l. 

15 The MAP joint probability p(s,s',y) was formulated to 

support the use of the maximum likelihood ML probability #p(y|x) 
in 1 in equations (1) and the corresponding log form of the ML 
decisioning metric DM in 3 in equations (1) , and to support the 
factoring into the product of the estimators a k -i,p k ,y k in 4 in 

20 equations (3) . This factoring in log form in 4 in equations (8) 
is equal to the sum of the log forms of these estimators ot k . 
ltQkrXk which are used for all of the turbo decoding algorithms, 
as well as for the covolutional decoding algorithms upon deleting 
the a-priori jd in y k in 6 in equations (6) . 

25 

The ML probability density function or likelihood ratio io 
f (y 1 x) — in equations — ft)-: — ML maximizes #£(y|x) with respect to x 
in order to find the best x which is equivalent to maximizing the 
decisioning metric DM in 3 in equations (1) equal to DM=- | y- 
30 x| 2 /2a 2 with respect to x where |y-x| is the geometric distance 
between x and y. This DM in 3 in equations (1) is the natural log 
of f (y I x) p (y 1 x) with the additive constants- removed. Maximizing 
DM is equivalent to minimizing |y-x| and therefore selects the x 
which is closest to y as the ML choice for x. ML decisioning 
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metric DM is used to make the bit decisions in turbo decoding as 
demonstrated in equations (7) , (8) , (9) , and is used to select the 
best trellis paths in convolutional decoding as will be 
demonstrated in the disclosure of this invention. 

5 

Our The new MAP probability p(s,s'|y) is the a-posteriori 
probability of s,s' given the observations y. This is the 
correct formulation for the MAP probability from a probability 
theorectic viewpoint Ref. [8] f and is made possible by our the 

10 use of the a-posteriori probability -§£(x|y) for the probability 
of the transmitted symbol x given the observed symbol y, in 
place of the likelihood ratioM L #p(y|x) in equations (1). It 
will be demonstrated that by using our the new MX decisioning 
metric DX, the p(s,s'|y) in log form can be factored into the 

15 sum of the our new recursive estimators which replace the a k _i,|3 k 
and our the new state transition probability £ k that replaces ¥ k 
currently used for all of the turbo decoding algorithms, 

The new maximum a-posterior MX replaces the maximum 
20 likelihood ML, and maximizes the a-posteriori probability dcnoify 
function f(x|y) p(x|y) of x conditioned on the observation y, with 
respect to the selection of x. Maximizing #£(x|y) is 

equivalent to maximizing with rcopoct to x, — the natural log of 
#£(x|y) equal — fee -and yields the new decisioning metric 
25 DX=Re(yx*) /a 2 - 1 x 1 2 /2a 2 +p (x) wherein p(x) is the natural log of 
p (x) , p luo — fcke — natural — logarithm — ln[f (x) -£ (x) -p (d) — e-f — the — a— 
priori — probability — f (x) -p (x) -p (d) — upon — deleting — fefee — additive 

constants . In the DX equation, — t4*e Re(o) is the real part of 

(o)^ and x* is the complex conjugate of x. MX and its 

30 decisioning metric DX select the x which is closest to y as the 
MX choice for x Tj _ even though the equations for DX arc linear in 

y — compared — fcre — fefee — quadratic — dependency — eft — y — — &M-. In the 

disclosure of this invention it will be demonstrated that the MX 
decisioning metric DX can be used to make the bit decisions in 
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turbo decoding and can be used to select the best trellis paths 
in convolutional decoding, — will — be — proven — that — tfee — MX — is- 
oquivalcnt — fee — ML — aftd — that — maximizing — BX — is — equivalent — 
maximizing DM for decisioning, — with an added improvement in BER 
performance using DX. 

Without any mathematical analysis, it should be apparent 
that DX has less noise compared to DM since DX is linear in y 
whereas DM involves the square of the vector y. This lower 
noise level translates into an improved decisionihg performance 

of DX compared to DM. Also, irfc — is — apparent — that — the 

calculations — — DM — use more multiply — aftd — addition — operations 

than DX, which means the DX should have a lower implementation 

complexity. 



BRIEF DESCRIPTION OF THE DRAWINGS 
AND THE PERFORMANCE DATA 



The above-mentioned and other features, objects, design 
algorithms, and performance advantages of the present invention 
will become more apparent from the detailed description set forth ; 
below when taken in conjunction with the drawings wherein like 
reference characters and numerals denote like elements, and in 
which: 

FIG. 1 is a representative block diagram of the 
implementation of a turbo encoder using a parallel architecture. 
Input user bits arc — [d(k) ) . — The code is a recursive systematic 
code — RBG — with — the — first — btfe — e£ — each — codeword — assigned — te — £ke 
systematic bit which arc the uncoded user data bits, part of the 
rcmainding set of bits in the codeword arc the ttl encoder output, 
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and the rcot of the bito within tho codeword arc the ft 2 encoder 

output. User input bito — [d(3c)) arc interleaved prior to handoff 

— fc&e — #2 — encoder — fee — make — the — #2 — encoder — output — almost 
statistically independent of the ft 1 encoder output in order to 
5 support — the iterative — convergence — of — feke — turbo — decoding. — A 
convolutional encoder uses cither ftl encoder or tho interleaved 

# 2 encoder. Output codewords for codeword k~l,2,. — — . , N arc the 

set o (k) -[c (k,b) ] — of bito — [b] of codeword k corresponding to tho 
input data bito — [d (k) ) . 

10 

FIG. 2 is a representative implementation block diagram 
for the turbo encoder and the convolutional encoder transmitter^ 
with — fehe — signal — processing — elements — relevant — to — turbo — aftd- 
convolutional — encoding, signal — generation, — aftd — transmission. 

15 Turbo/convolutional encoder output codewords [c (k) ) afe 

formatted, — symbol — encoded — (x (k) ) , — waveform modulated, — multiple 
access — encoded, — digital - to - analog — converted — by — a — DAC, — single 
sideband — upconvcrtod — B&B — to — aft — intermediate — f requnency — 3r£V 
upconvortod to a transmission or radio frequency RF, — handed off 

20 to the antenna > and transmitted. 

FIG. 3 is a representative block diagram of the 
implementation of a turbo decoder using a parallel architecture. 
The code is a recursive systematic code RSC with the first bits 
25 of each codeword tho systematic bits, — a subset of tho remaining 
bits — a^e — feke — #4 — encoder — output, — and — feke — other — subset — e4 — febe 
codeword arc the # 2 encoder output for the interleaved bits. — £ft 

each iteration the #1 decoder generates the output a - postcriori 

likelihood ratio L^in equations — (-9-) — using as a priori estimates 

30 of p the — dc interleaved — extrinsic — information -b^r — from — fefee — frS- 

decodor — output . £he — fri — decoder — calculates — its — extrinsic 

information L±g for use by the ft 2 decoder, using 3 in equations 

(9) . The ft2 — decoder — then — performs — the — corresponding — s-efe — e£ 

operations to calculate the for use by the #1 decoder in the 
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next iteration. When the otopping rule is activated, the tt2 

decoder — output — h^Ara — de - inter leaved — a**d — uocd — te — decide — t£e 
estimates for the turbo decoded user bito with the detection rule 
4 in equations — (9) . 

5 

FIG. 4 is a representative implementation block diagram 
for the turbo decoder and convolutional decoder receiver^ with 
the signal processing elements relevant to signal reception and 
processing, — symbol — recovery, — a**d — turbo /convolutional — decoding. 

10 ¥he — received — waveform — from — e**e — — multiple — users — 29,30 — i-s- 
rcccivcd and down - converted 31 to an IF, — synchronized in time and 

frequency — aftd — analog - to - digital — converted — AD€ — 32rz Complex 

outputs arc stripped of their multiple access 33 and the output 
symbols are detected 3 4 . Detected symbols — [y (k) ] — 35 — arc handed 

15 — the — turbo — decoder. — Turbo — decoded — output — estimates — — the 
received data arc dc - formatcd and error detected 37 to recover 

estimates — pdfk)--) — of the transmitted data [d(k)) 38. Throughout 

this patent the impact of the formatting and dc formatting has 
been — neglected — ae — is — general — practices which — means — that — fe-he 

A 

20 estimates (t t(k) -] arc assumed to be the turbo decoder outputs. 

FIG. 5 plots the Monte Carlo simulation of the decisioning 
metric performance for the MX decisioning metric 
DX=ln[ f (x | y) p (x[y)p (x|y) ] and the ML decisioning metric 

25 DM=ln[ f (y l x) p(yjx) ] against the symbol y signal-to-noise power 
ratio S/N. The equation DX~ln [f (x I y) ] takes into account that the 
a - priori probability p(x)-f(x) — factor is deleted and the additive 

constants deleted. Likewise, DM~ln (f [y 1 x) ] assumes the additive 

constants are deleted and has no means for including the effects 

30 of the a - priori probability p(x). Decisioning metric performance 

in the — leg — domain — is — the — difference between the — correct — aftd 

incorrect BPSK assumption for x. 
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FIG. 6 plots the improvement in S/N against the symbol y 
S/N— This improvcmcnt w hich improvement is the advantage in S/N 
from using our the M X decisioning metric^ in FIG. 5 compared to 
tke — current — Mh-, — — a — given — level — e€ — the — decisioning — metric 
performance in FIG. 5. 

FIG. 7 is a representative block diagram of a convolutional 
encoder. 

FIG. 8 is a representative block diagram of a convolutional 
decoder. 



DISCLOSURE OF THE INVENTION 



The new invention provides new decisioning metrics and new 
probabilities and new equations for the turbo decoding and 
convolutional decoding, which together provide performance 
improvements and reduce the decoder implementation complexities 
for all decoding architectures. In this invention disclosure, the 
new decisioning metric will be derived and evaluated prior to the 
derivation of the new probability equations and algorithm 
examples for the new decoding architectures for turbo and 
convolutional codes. 

Qttf — The M X a-posteriori probability f (x|y) p(x|y) defines 
the decisioning metric DX for turbo and convolutional decoding— 
whore — f (x I y) — irS — the — conditional probability of the — transmitted 

symbol — x — at — clock — k — fof — the — received — codeword — kr given — the 

received — symbol y. — The w herein the DX is derived from the MX in 
equations (11) . Step 1 uses the Bayes rule to derive MX p(xly) 
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MX decisioning metric DX (11) 

1 Bayes rule f-£(a,b) =f-£(a|b)#£ (b) =f-£(b|a)-f-£(a) 

enables _thc M X probability f(x|y) p (x|y) to be defined 

f (n | y) p(x|y) = f (y | x) p (y|x)- f-f* fp(x)/ f-p(y) 

2 The Gaussian oonditionalM L probability f (y|x) p (y|x) is 

f (y l x) p (ylx) = ( (2n) 1/2 a)' 1 exp (- 1 y-x 1 2 /2cr 2 ) 

3 The— Gaussian probability -#p(y) is 

#£{y) = ( (2jt) 1/2 a)" 1 exp (- I y 1 2 /2a 2 ) 
4 . Equations 2,3 yield the result for MX 



f (x l y) p(xly) = ^-f* fp(x) exp(Re{yx*) /a 2 -|x| 2 /2ct 2 ) / (2n) 

5 Taking the natural log and doloting 
tho additive conotant yields for MX DX 

DX = In [ p(x|y) ] 

ln[f (»|y) ]~ Re(yx*) /a 2 -|x| 2 /2a 2 + ln[f (x) p (x)j - 
= Re(yx*)/a 2 -|x| 2 /2a 2 + p(d) 

6 This MX equation reduces to 

ln[f(K | y)]~ Ro (yn*) /g 3 "— W- s /2 ^ i ln[p(d]) 

- DX I p_(d) 

wherein - ©X Ro (yx*) /a^ -fx+Vae? 

x* = complex conjugate of x 
p(d) = ^-fjef -p(x) since the symbol d 

corresponds to x 

£(d) = ln[p(d)] 
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usosthc Bqvgo rule to dcrivo from the ML p(ylx) and the p(y), p(x). 
f (x|y)-f (y|x) f (x) /f (y) . — Step 2 dcfinco is the f (vhQ the ML p(y|x) 

5. as the nnnrii 1 1 onnl Gaussian probability density function in 1 

in equations (1) Step 3 defines #£(y) as the Gaussian 
probability dcnoity function. Step 4 derives the MX f (x|y) p (x|y) 
from using the f (ylx) p (ylx) in 2 fey -and dividing by the #£(y) in 
3. Step 5 dcfinco takes the natural log of the MX a-posteriori 

10 probability ln[f (xly) ] after the — additive — constant hao been 

deleted, in step 4 to derive the — DX and wherein Step 6 rc writes 
the MX In [f (xly) ] — in 5 as the sum of our new docioioning metric 

©X and the log p(d) of the a-priori probability p(d) _~f (x) of 

^he — data word d is equal to the a-priori p(x) of the 

15 corresponding data symbol since x amplitude and phase encodes d. 
corresponding to x. 

FIG. 5 plots the Monte Carlo simulation decisioning 
performance 39 of the M X decisioning metric 

20 DX=ln[ f (xly) p(x|y) ] 41 and the ML decisioning matric 
DM= ln[ f (ylx) p (ylx) ] 42 against the symbol y signal-to-noise power 
ratio S/N 40. The equation DX-ln [f (x | y) ] takes into account that 
the a priori probability p(x)-f (x) — factor is deleted and the 
additive constants arc deleted . Likewise, Equation DM=ln (£p{y 1 x) ] 

25 assumes the additive constants- arc is deleted. Decisioning 
metric performance 39 in the log domain is the difference 
between the correct and incorrect BPSK assumption for x. For 
the MX DX, the simulated performance metric is equal to 
l n [<j-^4^ .p(x|y)> /<^p(x / ly)>] where <(o)> is the Monte Carlo 

30 statistical average over 100K trials of (o) , the f (x | y) p(x|y) is 
the correct decision for BPSK modulation, and #po(x' |y) is the 
incorrect decision. A-priori probabilities of x,x" are equal 
which means p (x) =p (x f ) =1/2 so that the p(x)=p(x') cancels out in 
the DX metric. The performance metric for the ML DM is the same 
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ln[<#p(y|x}/#p(y|x' )>. It is apparent from the data 41,42 that 
the required S/N to support a given level for the DX metric is 
considerably less than required for the DM metric. This directly 
translates into an improved BER performance. 

5 

FIG. 6 plots the improvement in S/N 43 against the symbol y 
S/N 44 This improvement 45 in S/N from using our the M X 
decisioning metric in FIG. 5 compared to the current ML, is the 
increase in S/N required for the ML metric to equal the value 
10 measured for the MX metric. Over the range of S/N of interest 
which is 0 to 10 dB, there is a -1-7 dB improvement in S/N which 
is significant and clearly translates into an improvement in BER. 
There are no other available means to offer this improvement for 
both turbo and convolutional decoding. 

15 

The new a-posteriori probability density p(s,s'|y) for MAP 
turbo is written as a function of the independent observations 
{y(j<k), y(k), y(j>k)} in equations (12) using 1,2 in equations 
(2). 

20 

New MAP a-posteriori p robab i 1 i t y (12) 

p(s,s'|y) =p(s,s'| y(j<k), y(k) y(j>k) ) 

25 

Recursive equation for p(s,s'|y) is derived in equations 
(13) following the steps in equations (3) for the p(s,s',y) 
recursive equations. Step 1 is the application of Bayes rule to 
partition the probability p(s,s'|y). Step 2 takes advantage of 
30 the assumption that the channel is memoryless to simplify the 



Recursive formulation of p(s,s'|y) (13) 
1 Bayes rule p (a,b) =p (a |b) p (b) can be used to 
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rewrite the p(s,s'|y) in equation (12) 

P(s,s'|y) = p(s,s'| y(j<k),y(k),y(j>k)) 
= p(s|s',y(j<k),y(k),y(j>k)) 
*p(s f ly(j<k),y(k),y(j>k)) 
where is a multiply operation 

2 Assuming the channel is memoryless 

P(s /S '|y) = p(s|s',y(k),y(j>k)) p(s'|y(j<k) 

3 The events { s' , y (k) } , {y ( j>k) } are independent 
since the channel is memorylessy- so we can 2 can be 
factored 2 into 

P(s,s' |y)=p(s|s' ,y(k) )p(s|y(j>k) )p(s' |y(j<k) ) 

4 This equation can be rewritten as a function of the 
a-posteriori recursive estimators and a-posteriori 

_state transition probability 

p(s,s',y) = Pk(sls') b k (s) a k -i(s') 

wherein by definition 

p k (s|s' ) = p(s|s' ,y(k) ) 
b k (s) = p(s|y(j>k)) 
a k -i(s' ) = p(s' |y(j<k) ) 

partitioning in step 1. Step 3 applies the identity 
p (a|b, c) =p (a |b)p (a I c) which is true when events b,c are 
independent p (b, c) =p (b) p (c) , to re-partition the first factor 
into the product of two factors. 'Step 4 transforms the joint 
probability in step 3 derived as a product of three 
probabilities , into the equivalent product of the two new state 
estimators a k -i (s' ) ,b k (s) and the state transition probability 
Pk(s|s') for the new MAP turbo decoding algorithm. The p k (s|s') 
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calculates p(s|s',y(k)) for each state transition assumption 
s-^s' for symbol set k. 



These a-posteriori estimators a k (s), b k (s), Pk(sls'), are 
5 part of this invention disclosure and are clearly distinct from 
the current set of ML estimators a ki (s' ) , p k (s) , y k (s,s') in 4 in 
equations (3) . 

Forward recursive equation for a k (s) is derived in equations 
10 (14) as a forward recursion which is a function of the p k (s|s') 
and the previous state estimate a k -i(s'). Step 1 starts with the 
definition of a k (s) which is derived from the equation for 
a k _i(s') in 4 in equations (13). In otcp Step 2 we-introduce:s the 
state s' by observing the probability summed over all values of 
15 s' is equal to the probability with s' excluded. In otcp Step 3 we 
apply applies Bayes rule to partition the probabilities. In step 
4 the assumption that the channel is memoryless enables the 
equation to be simplified to the form used in the MAP algorithm. 
In step 5, 

20 

Forward recursive equation for a k (s) (14) 

1 From the definition for a k -i(s') in 4 in equations 
(13) we find 

25 . a k (s) = p(s|y(j<k) ,y(k)) 

2 This probability can be written as the sum of 
joint probabilities over all possible states of s' 

a k (s) = San S ' P(s,s' |y(j<k),y(k)) 
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3 Applying Bayes rule 

a k (s) = Zaii s- P(s|s' ,y(j<k) ,y(k) ) p (s' I y ( j<k) , y (k) ) 

4 Applying the channel memoryless assumption 
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a k (s) = Sans- P(s|s',y(k)) p(s'ly(j<k)) 



5 Substituting the definitions of p k (s I s' , y (k) ) and 
a k -i(s') from 4 in equations (13) 
5 a k (s) = Zaii s' p k (s|s') a k -i(s f ) 



substitution of p k (s | s' , p (k) ) and a k -i(s') from 4 in equations 
(13) gives the final form for the recursive equation for a k (s) . 

10 

Backward recursive equation for b k -i(s') is derived as a 
backward recursion in equations (15) as a function of the 
p k (s' |s)=p(s' Is) and the previous estimate b k (s), following the 
steps in equations (14). Step 1 derives b k -i(s') from the 
15 equation for b k (s) in 4 in equations (13) . Step 2 is similar to 
steps 2,3,4 in equations (14). In step 3, using the equality 



Backward recursion equation for bk-i(s') (15) 
20 1 The definition for b k (s) from 4 in equations (13) 

b k -x(s' ) = p(s' |y(j>k-l) 

2 Similar to the steps 2,3,4 in equations (4) , we find 
b k -i(s' ) = Zaii s p(s|y(j>k) )p(s' |s,y(k) ) 
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3 Substituting the definitions of b k (s) from 4 
in equations (13) 

b k -i(s') = Lns b k (s) p k (s'|s) 



30 

p(s' |s,y(k) )=p(s|s' ,y(k) which is equivalent to the equality 
.p k (s'|s)= Pk(s|s'). and substitution of p k (s|s') from 4 in 
equations (13) gives the final form for the recursive equation 
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for b k _!(s'). The equality p k (s'|s) = p(s|s') simply recognizes 
that they are defined by the same MX equations as well as the 
same decisioning metric DX. 



5 Log of the state transition probabilities p k (s I s' ) =p k (s' I s) 

are derived in equations (16). The p k (s|s') is the probability 
of the decoder trellis state S(k-l)=s' transitioning to the next 
state S(k)=s given the observation y(k). For the backward 
recursion, the p k (s'|s) is the probability of the decoder 

10 trellis state S(k)=s transitioning from the previous state S(k- 
l)=s' given the observation y(k). In step 1 we rewrite the 
definition of p k (s|s') in 4 in equations (13) as the probability 
of the state transition s'->s given the observation y(k). Step 2 
rewrites 1 as the equivalent probability of the transmitted 

15 symbol x(k) corresponding to the transition s'->s. Step 3 are 
definitions similar to 2 in equations (6) . Step 4 expands the 
equations in 2 into a product over the codeword bits for the #1 
and #2 encoders 3 and 5 respectively in FIG. 1, of the 

20 

State transition probabilities p k (s|s')= p k (s'|s) (16) 

1 The p k (s|s') is defined in 4 in equations (13) 

p k (s|s' ) = p(s|s' ,y(k) ) 
= p(s'-»s|y(k)) 

25 

2 Since the transition s'->s is defined by x(k) 

P*(s|s' ) = p(x(k) |y(k) ) 

3Wg introduce the definitiono Definitions 2 in equations 
30 (6) have the properties 

with the properties 

d(k) = input data corresponding to x(k) 
p(d(k)) = p(x(k)), = a-priori probability of d(k) 
x(k) = {x(k,b)), b refers to the codeword bits 
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y(k) = {y(k,b)}, b refers to the codeword bits 



4 These definitions and the memoryless assumption, enable 
equations 2 to be expanded 

P*(s|s' ) = p(x(k) |y(k) } 

= Fib P(x(k,b) |y(k,b)) 

5 From Using 4 in equations (11) and tho identity 

P(x | y)-f (jc|y) e nables this equation to be rewritten 
p k (s|s')= lib [(27T) 1/2 a)^ 1 exp(DX(k / b)) p(d(k)) 
= p k (s / |s) = 

6 MX decision metrics DX(k,b), DX ( o 1 o ' ) ~DX ( o ' I o ) are 
from 6 in equations (11) 

DX = DX(s|s f ) 
DX(o | o') 

= S b DX(k,b) 

= 2 b Rpfy/k.blxMk.bll/a 2 -lx(k,b) 1 2 /2a 2 +p (d (k) ) 

= m(s' i s) 

7 Log equations for £ k ( s I s ' ) =£ k ( s ' I s ) are the log of 5 
using 6 and deleting the additive constants 

£ k (s|s') = DX(s|s') i p(d(k) ) 
= DX(s' Is) i £(d(k)) 
= £ k (s' Is) 



probabilities for each bit p (x (k, b) I y (k,b) ) . In otcp Step 5 we 
introduces the standard turbo code assumption that the channel 
is Gaussian and uses BPSK (Binary phase shift keying) symbols 
which means d(k)=+/-l identical to the starting assumptions for 
equations (11) , with a equal to the one sigma Gaussian noise 
along the inphase and quadrature axes. 
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In otop Step 6 we— generalizes the MX decisioning metric DX 
in 6 in equations (11) for p (x 1 y) -f (x 1 y) p (x I y) , to DX(k,b) for 
p(x(k,b) |y(k,b) )=f (x(k,b) ly(k,b) ) , and to DX ( s | s ' ) =DX ( s ' | s ) equal 
to the sum of the DX(k,b) over all s-»s' and s'-»s transitions 
5 respectively, which is the sum over all bits {b} for clock k 
equal to codeword k. Step 7 takes the log of 5 and deletes the 
additive constants to give the log equations for the state 
transition probabilities £ k (s I s' ) =£ k (s' I s) as linear sums of the 
DX(s|s' ) , DX(s' |s) and the log of the a-priori data probability 
10 £(d(k)). The p k (s|s' )= p k (s' Is) will be used in turbo decoding 
algorithms, and in convolutional decoding algorithms when the log 
a-priori probability p(d(k)) is deleted. 

Log equations for a k (s), b k _i(s') are derived in equations 
15 (17) from equations (14) , (15) respectively for a k (s), b k -i(s') 
using the definition of J3 k (s|s') in 7 in equations (16), Step 1 
gives the log equation for a k (s~) by taking the log of the a k (s) 



20 Log equations for the a-posteriori 

metrics a k (s), b k -i(s') (17) 

1 Log_^ a k (s) , of a k (s) 

a k (s) - ln[ Zaii 3 >exp(a k -i(s' )+DX(s|s / ) I £(d(k) )] 

25 

2 Log^_ b k _i ( s ' ) , of b k - i (s / ) 

b k _i(s')=ln[ Zaiisexp (b k (s)+DX(s / Is) i p(d(k) ) ] 



30 equation in 5 in equations (14) and using the definition of 
£k(s|s') in 7 in equations (16). Step 2 takes the log of the 
equation for b k _i(s') in 3 in equations (15) to derive the log 
equation for b k _i(s') and uses the definition for £ k (s|s') in 7 in 
equations (16) . 



34 



Our — The new MAP equations for the log likelihood ratio 
L(d(k)|y)) are derived in equations (18). Step 1 is the definiton 
from references [1],[2]. Step 2 replaces p(d(k)) with the 
5 equivalent sum of the probabilities that the transition from 

S(k-l)=s' to S(k)=s occurs and which are eu* the new 

probabilities p(s,s'|y) over these transitions. Step 3 

substitutes the log of the recursive estimators a k -i (s' ) , b k (s) , 
from 1,2 in equations (17) and the p k (s|s') from 7 in equations 
10 (16) . Step 4 
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Our The new MAP equations 
1 Definition 

L(d(k) ) |y) = ln[p(d(k)=+l|y) ] 
-ln[p(d(k)=-l|y) ] 



(18) 



20 



2 Probability of p(d(k)) is the sum of the probabilities 
that the state S(k-l)=s' transitions to S(k)=s 
L(d(k))|y) = ln[ Z (SfSMd(k)5=+1) p(s,s'|y)] 
-ln[ 2(s fS 'id<k)-i) p(s,s'|y) ] 



25 



3 Our The new MAP equation is obtained by substituting the 
a k -i(s' ) ,b k (s) , £ k (s|s' ) 

L(d(k))|y) = ln[ 2 (s , sMd{k)=s+1) p(s,s'|y)] 
-ln[ E( S ,s'id(k)»-i) P(s,s'|y) ] 
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ln[E {SfSMd(k ,. + i, exp(a k _i(s / ) +DX (s I s' ) 
-In [Z (g ,s' , d (k)=-i) exp (a k _i (s' ) +DX (s I s' ) 




+b k (s))] 
+b k (s))] 



43 Hard decisioning rule 

d(k) = +1/-1 when L(d(k)|y) > 0 / < 0 
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5 Soft decision metric = L(d(k)) |y) 



5 gives the hard decisioning rule. Step 5 identifies L(d(k) |y) to 
be the soft decisioning metric. 

FIG. 1 describing a representative turbo encoding block 
diagram for a parallel architecture and FIG. 2 describing a 
10 representative implementation block diagram of a turbo encoder 

and transmitterT apply to our the invention, since wc aro not 

addressing any changes to the encoding. 

Fig. 3 describing a representative turbo decoding block 
15 diagram and FIG. 4 describing a representative receiver block 
diagram for a turbo decoder receiver , apply to our the invention 
when the turbo decoding signal flow diagram in FIG. 3 implements 
the MAP iterative algorithm in . equations (9) using — the 
likelihood ratios in equations (18) . Ou^ -The decisioning metric 
20 performance advantage of -1.7 dB in FIG. 5,6 will support a BER 
improvement in the MAP algorithm (9) . 

Convolutional decoding starts with the assumption s that wc 

decoding of a sequence of observed channel output symbols 

25 {y(k), k=l,2,...,N} of the receiver where %x k" is the running index 
over the N transmitted symbols. Each set y(k) of symbols at 
clock k consists of the observed uncoded and coded symbols for 
the received codeword k at clock k. These are the same starting 
set of assumptions used for turbo decoding. 

30 

FIG. 7 is a representative convolutional encoder block 
diagram. Input 46 to the encoder are the user data bits {d(k)} 
for k=l,2,. . . ,N. The encoder for a convolutional code uses a 
recursive systematic code RSC or a systematic code SC which means 
35 the first codeword bit 47 is the user data bit called systematic 
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bit, or bits, which are uncoded. These user data bits {d(k)} 
are also handed over to the encoder 48 followed by interleaving 
49. Output bits 50 are punctured to obtain the correct code 
rate and multiplexed 51 into a continuous output bit stream 52 of 

5 codewords {c(k)} for each of the codeword clocks k=l,2, Each 

codeword c(k) 52 is a set of bits consisting of the systematic 
bits followed by the encoder and interleaver output bits 52. 

FIG. 8 is a representative convolutional decoder block 
10 diagram. Inputs are the detected soft output symbols 53 from 
the received channel demodulator which detects and recovers these 
symbols. This stream of output symbols consists of the outputs 
for the systematic bit b=l and the outputs from the interleaved 
and encoded bits. Following de-interleaving 54 the convolutional 

15 decoder recovers estimates {d(k)} of the user input bits {d(k)} 
to the convolutional encoder. 

Convolutional decoding similar to the Viterbi algorithm, 
solves the recursive equations [Ref. 2,3,5] derived from 

20 equations (7) by replacing the summations over all possible 
transitions with the best transition path to each of the new 
trellis states. The best transition path for convolutional 
decoding is the best choice of s' for each forward path s'-^s and 
the best choice of s for each backward path s->s' , where best is 

25 the maximum value of the state metric for the path transitions. 

For the forward recursion the log ML equations are derived 
in equations (19) using the redefined state path metric a k (s) 
and the state transition decisioning function DM. Step 1 is the 

30 

Forward equations for ML convolutional decoding (19) 
1 The ML probability density has the well-known 
factorization assuming a memoryless channel 
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p(y(k)|s) = ri;j=i._,k-i P(y(j) Isj-i -»Sj) 

= p(y(k) |s'-»s) p(y(k-l) |s') 



2 State path metric a k (s) in log format is 
5 a k (s) = £(y(k) |s) 

3 Forward equations for Ok(s) are derived using 2 
and the log of 1— Wo find to yield 

a k (s) = max [ E (y (k-1) | s' ) + E (y (k) | s' -*s) ] 

10 = max [ctk-^s') + DM(s|s')] 

DM(s|s' ) = £(y(k) |s'-»s)] 

= -|y(k)-x(k) | 2 /2a 2 



15 factorization of the ML probability that is allowed by the 
memoryless channel assumption. Step 2 is the definition of the 
path metric a k (s) in log format which is different from its 
definition in 1 in equations (4) for MAP turbo decoding. Step 3 
derives the forward recursive equation for a k (s) by combining the 

20 equations in 1 and 2 and using the definition of the ML 
decisioning metric DM=ln [p (y (k) | s' ->s) ] = p (y (k) | s' ->s) ] for the 
path s'-^s for convolutional decoding. Path metrics and the 
corresponding data d(k) bit for each trellis state are stored in 
a state matrix. The best path corresponding to decoding state k 

25 is used to select the best data d(k-D) bit decision at the state 
k-D of this path stored in the state matrix, where D is a delay 
in the data bit decisioning that is required for reliable 
decoding. 

30 For the backward recursion the log ML equations are derived 

in equations (20) using the state path metric J3 k (s) in 2 in 
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equations (7) , and the state transition probability Xk(s f s') and 
decisioning metric DM(s|s f ) from 4,5,6 in equations (6). Step 1 

Backward equations for ML convolutional decoding (20) 

1 State path metric gk-i(s') in log format is equal 
to the value 1 in equation (5) 

fi k -x(s') = ln[p(y(j>k-lKs')] 

- p(y(j>k-l) Is')] 

2 Backward equations for J3k-i(s') are derived using 1 
and the 2,3 in equations (5)- Wo find to yield 

fic-i(s') = max [ E (y(j>k) Is) + £(s,y(k) Is')] 

s 

= max tfik(s) + DM(s|s' ) ] 

s 

DM(s'ls) = -|y(k)-x(k) | 2 /2a 2 

is the definition of fik-i(s') in 1 in equations (5). Step 2 
modifies the derivation of gk-i(s') in equations (5) and the final 

20 equation for fik-i(s') in 2 in equations (7) to derive the gk-i(s') 
for the backward convolutional decoding, with the modifications 
being 1) setting the a-priori probability £(d(k)=0 since there 
is no a-priori probability available, and 2) replacing the 
summation over all s with the maximum with respect to s of [J3 k (s) 

25 + DM(s|s')]. Path metrics and the corresponding data d(k) bit for 
each trellis state are stored in a state matrix. The best path 
corresponding to decoding state k is used to select the best data 
d(k+D) bit decision at the state k+D of this path stored in the 
state matrix, where D is a delay in the data bit decisioning 

30 that is required for reliable decoding. 
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Ow? — The new convolutional decoding equations (21) for 
forward and backward recursions are modifications of the 
previously derived MAP equations for a k (s) in equations (14), 
b k _i(s') in equations (15), DX (s I s' ) =DX (s' I s) in equations (16), 
5 and the final equations for a k (s), b k -i(s') in 1,2 in equations 
(17). Modifications consist of 1) setting |>(d(k))=0 since there 
is no a-priori information on p(d(k)), and 2) replacing the 
summation over all s f ,s with the maximum of [a k -i (s' ) +DX (s I s' ) ] , 
[b k (s) +DX (s' |s)] respectively with respect to the path transition 
10 s'-^s,s->s' respectively. 



Our The new a-posteriori convolutional decoding 
equations 



(21) 
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1 Definition of a k (s) from 1 in equations (14) 



a k (s) = £(s|y(j<k) 



2 Forward recursion for a k (s) can be derived by 



20 



modifying the derivation of a k (s) for the MAP 
turbo decoding-^ — Wo find to yield 



a k (s) = max [a k _i(s' ) + DX(s|s')] 



DX(s|s')] = Re[y(k)x*(k) ] /a 2 -|x(k) 1 2 /2a 2 +p (d (k) ) 



25 
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Definition of b k -i(s') from 1 in equations (15) 
b k - x (s') = p(s' |y(j>k-l) ) 



4 



Backward- recursion for b k -i(s') can be derived by 
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modifying the derivation of b k ~i(s') for the MAP 
turbo decoding-; — Wo fin d to yield 



b k -i(s') = max[b k (s)+ DX(s'|s)] 



s 



DX(s'ls)] = Re[y(k)x* (k) ] /a 2 -|x(k) 1 2 /2a 2 +p (d (k) ) 



Step 1 for — the new forward recursion uses the same 
definition of a k (s) for the MAP turbo decoding in 1 in equations 
5 (14)^ — with — the — modification — that — the — a - priori — probability 

£(x(k) )^p(d(k) )-0 corrcoponding — — setting — the — probability 

p(d(k)-il)-p(d(lc)- l)-l/2 . Step 2 then follows the steps in 
equations (14) , (16) leading to the equations 1 in equations (17) 
for a k (s) for the MAP turbo decoding, upon replacing the 

10 summation over s' with the maximization with respect to s' 
similar to the derivation of the forward recursion equations for 
a k (s) in (19). Path metrics and the corresponding data d(k) bit 
for each trellis state are stored in a state matrix. The best 
path corresponding to decoding state k is used to select the best 

15 data d(k-D) bit decision at the state k-D of this path stored in 
the state matrix, where D is a delay in the data bit decisioning 
that is required for reliable decoding. 

Step 3 for our the new backward recursion uses the same 
20 definition of b k -i(s') for the MAP turbo decoding in 1 in 
equations (15) with the modification that the a-priori 
probability p (x (k) ) (d (k) ) =0 corresponding to setting the 
probability p (d (k) =1) =p (d (k) =-1) =1/2 . Step 4 then follows the 
steps in equations (15), (16) leading to the equations 2 in 
25 equations (17) for b k -i(s') for the MAP turbo decoding, upon 
replacing the summation over s with the maximization with respect 
to s similar to the derivation of the backward recursion 
equations for g k _i(s') in (20). Path metrics and the corresponding 
data d(k) bit for each trellis state are stored in a state 
30 matrix. The best path corresponding to decoding state k is used 
to select the best data d(k+D) bit decision at the state k+D of 
this path stored in the state matrix, where D is a delay in the 
data bit decisioning that is required for reliable decoding. 
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Preferred embodiments in the previous description of the 
probabilities, decisioning metrics, algorithms, and 
implementations, are provided to enable any person skilled in 
the art to make or use the present invention. The various 
5 modifications to these embodiments will be readily apparent to 
those skilled in the art, and the generic principles defined 
herein may be applied to other embodiments without the use of the 
inventive faculty. Thus, the present invention is not intended 
to be limited to the embodiments shown herein but is intended to 
10 be accorded the wider scope consistent with the principles and 
novel features disclosed herein. 

It should be obvious to anyone skilled in the 
communications art that these example probabilities, decisioning 
15 metrics, algorithms, and implementations, define the 

fundamental architecture and signal processing relevant to this 
invention disclosure and it is obvious that this example is 
representative of the other possible signal processing 
approaches^ 

20 

For cellular applications the transmitter — description 

FIG. — 3 — fes? — both — turbo — and — convolutional — encoding — includes 
transmission — signal processing applicable — to this — invention — fo^ 
both the hub and user terminals, — and the receiver description in 
25 FIG. 4 includes equations (16) , (17) , (18) , (9) , (10) for our the new 
turbo decoding and equations — f£-3r) — for the our new convolutional 
decoding and describes the corresponding receiving signal 

processing for the cellular hub and user^ terminals 

applicability to this invention. 

30 

For optical communications applications the microwave 
processing at the front end of both the transmitter and the 
receiver is replaced by the optical processing which performs the 
complex modulation for the optical laser transmission in the 
35 transmitter and which performs the optical laser receiving 
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function of the microwave processing to recover the complex 
baseband received signal. 
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FIG. 2 Turbo/Convolutional Code Transmitter 
Block Diagram 
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FIG. 3 Iterative Turbo Decode Block Diagram 
for Parallel Architecture 
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4 Turbo/Convolutional Code i 
Block Diagram 
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